Energy Demand Forecasting Model Performance Report

The following report contains model performance metrics for the NY City Hourly Probabilistic Residential Energy Demand Forecasting Pipeline. Model performance was evaluated on both long-term and day-ahead forecasts. Evaluation was conducted using a holdout dataset of hourly energy demand values between 2023-09-01 and 2024-03-31.

Long-Term Forecasting Performance

The following table contains performance metrics for the forecasting model compared with a yearly moving average baseline model.
MSE Weighted MSE MAE MAPE Wilcoxon Test p-value
Forecasting Pipeline 289065.70 247292.94 364.55 0.07 0.0
Baseline Yearly MA 834403.82 834403.82 685.20 0.13 NaN

The following Plotly Figure helps to contextualize the forecasting model's performance by showing its predictions along with the actual energy demand values. It also presents the 95% confidence interval bounds estimated by the forecasting model.



Day-Ahead Forecasting Performance

The following table contains performance metrics for the forecasting model compared with a yearly moving average baseline model.
MSE Weighted MSE MAE MAPE Wilcoxon Test p-value
Forecasting Pipeline TBD TBD TBD TBD TBD
EIA Forecasts 136775.85 TBD 308.38 0.06 NaN

The following Plotly Figure helps to contextualize the forecasting model's performance by showing its predictions along with the actual energy demand values. It also presents the 95% confidence interval bounds estimated by the forecasting model.



Model Sensitivity Analysis

The following data has been made up for demonstration purposes. Actual data will be provided in a future update.

Sensitivity Analysis